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! Abstract 
(N . 

We introduce a new family of symmetric functions, which are g-analogues 
of products of Schur functions, defined in terms of ribbon tableaux. 

These functions can be interpreted in terms of the Fock space representa- 
I tion of Uq{sln), and are related to Hall-Littlewood functions via the geom- 

' etry of flag varieties. We present a series of conjectures, and prove them in 

special cases. The essential step in proving that these functions are actually 
symmetric consists in the calculation of a basis of highest weight vectors of J- 
. ^ using ribbon tableaux. 
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1 Introduction 

This article is devoted to the study of a new family of symmetric functions H^\X; g), 
defined in terms of certain generalized Young tableaux, called ribbon tableaux, or 



rim-hook tableaux |46|. 



These objects, although unfamiliar, arise naturally in several contexts, and their 
use is implicit in many classical algorithms related to the symmetric groups (see 
e.g. Robinson's book In particular, they can be applied to the description of 

the power-sum plethysm operators ip'^ : f{{xi}) ^ fii^i}) on symmetric functions 
0, and this point of view suggests the definition of a natural g-analogue ipn of ^ip^. 



This g-analogue turns out to make sense when the algebra of symmetric functions is 
interpreted as the bosonic Fock space representation of the quantum affine algebra 
Uq{slk)- Indeed, one can prove, building on recent work by Kashiwara, Miwa and 



Stern that the image ip^if) of any symmetric function by this operator, is 



a highest weight vector for Uq{slk). In particular, the images ipq{hx) of products of 
complete homogeneous functions have a simple combinatorial description, and can 
be used as a convenient basis of highest weight vectors. 

The space of symmetric functions is endowed with a natural scalar product (the 
same as in the Fock space interpretation), and one can consider the adjoint (f^ of 
the g-plethysm operator ip^. This operator divides degrees by k, and sends the 
Schur functions Sk\ indexed by partitions of the form kX = {kXi, k\2, . . . , kXr) onto 
a new basis, which is essentially the one considered in this paper. More precisely, 
H^\X; = (pg{sk\)- It should be said, however, that our original definition was 
purely combinatorial, and that the connection with Uq{slk) was understood only 
recently. 

The if-functions are generalizations of Hall-Littlewood functions. We prove 
that for k sufficiently large, H^^ = Q'^, where Q'^ is the adjoint basis of Pa for the 
standard scalar product. Moreover, we conjecture that the differences H^'^^^ ~ 
are nonnegative on the Schur basis, i.e. that the if-functions form a filtration of 
the Q'-functions. In particular, the coefficients of if-functions on the Schur basis 
are conjectured to be polynomials with nonnegative integer coefficients. 

The Q'-functions are known to be related to a variety of topics in representation 
theory [0, |2^, ^ ^ , algebraic geometry |TE|, ^] , combinatorics 



p9| , pO| , IJ] and mathematical physics [|T^, |2T[]. As a general rule, g-analogues re- 
lated to quantum groups admit interesting interpretations when the parameter q is 
specialized to the cardinality of a finite field, or to a complex root of unity. The 
Q'-functions are no exception. In the first case, the coefficients Kxfj_{q) of Q'^ on the 
Schur basis are character values of the group (jL„(Fg) while in the second one. 



a factorization property reminescent of Steinberg's tensor product theorem leads to 
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combinatorial formulas for the Scliur expansion of certain plethysms, in particular 
for ip''{h^) il,|2|]. 



On the basis of extensive numerical computations, we conjecture that the H- 
functions display the same behaviour with respect to specializations at roots of unity, 
giving this time plethysms ip'^isx) of Schur functions by power sums. In fact, the H- 
functions were originally defined as g-analogues of products of Schur functions, being 
the natural generalization of those introduced in |0. A combinatorial description 
of general if-functions on the Schur basis, similar to the one given in in terms 
of Yamanouchi domino tableaux, would lead to a refined Littlewood-Richardson 
rule, compatible with cyclic symmetrization in the same way as the rule of is 
compatible with symmetrized and antisymmetrized squares. This means that if one 
splits a tensor power V^'' of an irreducible representation V\ of U(n) into eigenspaces 
E^^^ of the cyclic shift operator f i (S> f 2 <S> ■ ■ ■ ® "^fc ^ V2®v^0 ■ ■ ■ ®Vk®Vi, each i?^*) 
is a representation of \J{n) whose spectrum is given, according to the conjectures, 
by the coefficient of in the reduction modulo 1 — g'^ of H^^{q). 

All the conjectures are proved for k = 2 (domino tableaux) and for k sufficiently 
large (the stable case). The case of domino tableaux follows from the combinato- 
rial constructions of and [|l9l, while the stable case rely on the interpretation 



of Kostka-Foulkes polynomials in terms of characters of finite linear groups, and as 
Poincare polynomials of certain algebraic varieties, in particular on the cell decom- 
positions of these varieties found by N. Shimomura | J45|| . 

This article is structured as follows. In Section 0, we recall some properties of 
Hall-Littlewood functions, in particular their interpretation in terms of affine Hecke 
algebras and their connection with finite linear groups. In Section ^ we explain the 
connexion between plethysm and Hall-Littlewood functions at roots of unity, and 
in Section |^, we show how to translate these results in terms of ribbon tableaux. 
The application of ribbon tableaux to the construction of highest weight vectors 
in the Fock representation of f/g(s[„) is presented in Section ^ and connected to 
a recent construction of Kashiwara, Miwa and Stern [|16|. In Section |^, we define 
the if-functions, and summarize their known or conjectural properties. Section |^ 
establishes these conjectures for if-functions of level 2, corresponding to domino 
tableaux. In Section H, we recall Shimomura's cell decompositions of unipotent 
varieties, and show the equivalence of his description of the Poincare polynomials 
with a variant needed in the sequel. From this, we deduce that the i7-functions of 
sufficiently large level are equal to Hall-Littlewood functions, which is also sufficient 
to prove all the conjectured properties in this case. 



2 Hall-Littlewood functions 

Our notations for symmetric functions will be essentially those of the book , to 
which the reader is referred for more details. 

The original definition of Hall-Littlewood functions can be reformulated in terms 
of an action of the affine Hecke algebra H^^q) of type y4jv_i on the ring C[xf ^, . . . , x^^] 

i- 
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The affine Hecke algebra Hn^q) is generated by Tj, i = 1, . . . , N — 1 and ^, 
i = 1, . . . , N, with relations 

Tf = {q- l)Ti + q \ ^'^^ ^ 

J-i-l-i+lJ-i — J-i+lJ-iJ-i+1 1 _ ( '[\ 

= T,T, (|j - ^1 > 1) y^^^- ^^yi^' 7 f - f ^-^^ 

yyj+iTj=Tjyj + [q-l)yj+i 

If 0" = (Ji^ai^ ■ • ■ CTj,, is a reduced decomposition of a permutation a E Sn, where 
(Tj = (z,^ + 1), one sets as usual = Ti^Ti^ ■ ■ - Ti^, the result being independent of 
the reduced decomposition. 

Let Aiv(g) = Y\_ il^i ~ ^j)- Then, on one hand, the Hall-Littlewood poly- 

l<i<j<N 

nomial Q\{xi, . . . ,XN',q) indexed by a partition A of length < is defined by ^2 



where tjiq = N — £(A) and the g-integers are here defined by [n]g = (1 — — q)- 

On the other hand, H^iq) acts on C[xf^,...,xf^] by yi{f) = xtf and Tj = 
(g — l)TTi + ai, where vTj is the isobaric divided difference operator 

Xif - Xi+iai{f) 
Ml) = z ' 

and it is shown in ^ that if one defines the g-symmetrizing operator S^^'^ G H]\i{q) 

by 

= (3) 

then 

Q,(xi,...,x^;g) = ^i^^^S(^)(x^) . (4) 

The normalization factor l/[mo]g! is here to ensure stability with respect to the 
adjunction of variables, and if we denote by X the infinite set X = {xi, X2, ■ ■ ■ , } 
then Qx{X; q) = limAr^oo Qx{xi, . . . , Xat; g). 

The P-functions are defined by 

where rrii is the multiplicity of the part z in A. 

We consider these functions as elements of the algebra Sym = Syni{X) of sym- 
metric functions with coefficients in C(g). In this paper, the scalar product (, ) 
on Sym will always be the standard one, for which the Schur functions s\ form an 
orthonormal basis. 

We denote by {Q'^{X;q)) the adjoint basis of P\{X;q) for this scalar product. 
It is easy to see that Q'f^{X; q) is the image of Q^{X] q) by the ring homomorphism 



Pfc I— > (1 — g'') (in A-ring notation, Q'^{X;q) = Q{X/{1 — q);q)). In the Schur 
basis, 

Q'^iX;q) = Y.K,,iq)s,iX) (5) 

A 

where the Kx^{q) are the Kostka-Foulkes polynomials. The polynomial K\^{q) is 
the generating function of a statistic c called charge on the set Tab (A, /x) of Young 
tableaux of shape A and weight /i (|3^, see also p4|, ^) 



^A,(g)= E (6) 

tGTab (A,^t) 

We shall also need the Q'-functions, defined by 

Q;(X; g) = E k,,{q)sx{X) = q-^^^Q'^{X- q-') . (7) 

A 

The polynomial Kx^{q) is the generating function of the complementary statistic 
c(t) = n{fi) — c(t), which is called cocharge. The operation of cyclage endows 
Tab (A, yu) with the structure of a rank poset, in which the rank of a tableau is equal 
to its cocharge (see p^). 

When the parameter q is interpreted as the cardinality of a finite field Fg, it 
is known that Kx^{q) is equal to the value %'*'('") of the unipotent character x'^ of 
G = GLn(Fq) on a unipotent element u with Jordan canonical form specified by the 
partition (see ||36|] ). 



In this specialization, the coefficients 

Gu,{q) = {K,Q'^) (8) 

of the Q'-functions on the basis of monomial symmetric functions are also the values 
of certain characters of G on unipotent classes. Let denote a parabolic subgroup 
of type u of G, for example the group of upper block triangular matrices with 
diagonal blocks of sizes z/i, . . . , and consider the permutation representation of 
G over C[G/V,y]. The value ^,"{9) of the character ^'^ of this representation on an 
element (7 G G is equal to the number of fixed points oi g on G /Vy. Then, it can be 
shown that, for a unipotent u of type /i, 

C{u) = G.,{q) . (9) 

The factor set G/Vv can be identified with the variety J^y of z/-fiags in = 

c c . . . c = V 

where dim Vi = i. Thus, Gy^{q) is equal to the number of F^-rational points of the 
algebraic variety JF" of fixed points of m in JF^. 
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3 Specializations at roots of unity 



As recalled in the preceding section, the Hall-Littlewood functions with parameter 
specialized to the cardinality g of a finite field Fq provide information about the 
complex characters of the linear group GL{n, Fq) over this field. It turns out that 
when the parameter is specialized to a complex root of unity, one obtains information 
about representations of GL{n, C) (or U{n), that is, a combinatorial decomposition 



of certain plethysms ||2^, We give now a brief review of these results. 

The first one is a factorization property of the functions g) when q is 

specialized to a primitive root of unity. This is to be seen as a generalization of 
the fact that when q is specialized to 1 the function Q'xi^] q) reduces to h\{X) = 



Theorem 3.1 ||25| Let X = (i'"i2™'2 _ _ . n"*") be a partition written multiplicatively. 
Set rrii = kqi + ri with < ri < k, and fi = [V^2^^ . . . n'""). Then, ( being a primitive 
k-th root of unity, 

Q'xiX; C) = g;(X; C) UlQ^iX; (T ■ (10) 

i>l 

The functions Q'^.k-j{X-X) appearing in the right-hand side of (|1^) can be ex- 
pressed as plethysms. 

Theorem 3.2 |25| Let pk o hn denote the plethysm of the complete function /i„ by 
the power-sum pk, which is defined by the generating series 

n I I /-r 



Y,Pkohn{x)z^= n(i 



zx 



Then, if ( is as above a primitive k-th root of unity, one has 

g'(„.)(X;C) = (-l)('=-^Nfco/i„(X). 

For example, with k = 3 = e^*'^/^), we have 
Ql444333ii(^; = Q',uiX; Q'sssiX; C) Q'UX; C) = C)P4 o h,, . 

Let V" be a polynomial representation of GL{n, C), with character the symmetric 
function /. Let 7 be the cyclic shift operator on V^^, that is, 

7(f 1 ® V2 ® ■ ■ ■ (S) Vk) = V2 (S) V3 (g) ■ ■ ■ (g) Vk (S) Vi . 

Let C = exp(2i7r//c), and denote by E^'^'^ the eigenspace of 7 in associated with 
the eigenvalue As 7 commutes with the action of GL{n), these eigenspaces are 
representations of GL{n), and their characters are given by the plethysms ° f of 
the character / of by certain symmetric functions i^^"^ that we shall now describe. 

For A;, n G N, the Ramanujan or Von Sterneck sum c{k, n) (also denoted $(A;, n)) 
is the sum of the /c-th powers of the primitive n-th roots of unity. Its value is given 
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by Holder's formula: if {k,n) = d and n = md, then c{k,n) = fi{m)(j){n)/(f){m), 
where /i is the Moebius function and is the Euler totient function (see e.g. |^ ). 

(r) 

The symmetric functions £1 are given by the formula 

^^ = TEc(r,rf)pr • (11) 

d\k 

These functions are the Frobenius characteristics of the representations of the sym- 
metric group induced by irreducible representations of a transitive cyclic subgroup 
P]. A combinatorial interpretation of the multiplicity {sx , i^^^) has been given by 



Kraskiewicz and Weyman ||23|. This result is equivalent to the congruence 



0<A,<n-l 

Another proof can be found in 0] . Now, if is a product of exterior powers of the 
fundamental representation C" 

V = A^^C" ® A'^^C" O • ■ ■ O A'^'-C" 

the character of E^^^ is itKe,, and similarly if V is a product of symmetric powers 
with character h^, the character of E 

Given two partitions A and /x, we denote by A V the partition obtained by 
reordering the concatenation of A and u, e.g. (2, 2, 1)V(5, 2, 1, 1) = (5, 2^, 1^). We 
write fi^ = ■ ■ -V/i [k factors). If /i = (/ii, . . . , /x^), we set fc/x = (/c/ii, . . . , fc/ir)- 

Taking into account Theorems and and following the method of @] , one 
arrives at the following combinatorial formula for the decomposition of i?*^^-* into 
irreducibles: 

Theorem 3.3 |26| Let ci he the i-th elementary symmetric function, and for 
A = (Ai, . . . , Am), ca = ■ ■ ■ ca^. Then, the multiplicity {s^ , l'^^^ o e\) of the Schur 
function in the plethysm I). oe\ is equal to the number of Young tableaux of shape 
n' (conjugate partition) and weight whose charge is congruent to r modulo k. 
This gives as well the plethysms with product of complete functions, since 

, (r) , j {Sf,, i'^k^ ohx) if\\\iseven 
[ {s^ 5 H ° '^A/ y |A| IS odd 

where = uj{i^^^) = 4'^ with s = k{k - l)/2 - r. 

For example, with = 4, r = 2 and A = (2), 

(2) 

£l' 62 = S43I + S422 + S41111 + 2S3311 + 2S3221 

+2S32111 + S2222 + -522211 + 2^221111 + S2111111 • 
(2) 

The coefficient (S32111 , ^4 o 62) = 2 is equal to the number of tableaux of shape 
(3, 2, 1, 1, 1)' = (5, 2, 1), weight (2, 2, 2, 2) and charge = 2 ( mod 4). The two 
tableaux satisfying these conditions are 
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which both have charge equal to 6. 

Similarly, (5732, ^4^''oe2i) = 5 is the number of tableaux with shape (3, 3, 2, 1, 1, 1, 
weight (2, 2, 2, 2, 1, 1, 1, 1) and charge = 2 ( mod 4). 

Another combinatorial formulation of Theorems |3.1| and can be presented 
by means of the notion of ribbon tableau, which will also provide the clue for their 
generalization. 



4 Ribbon tableaux 

To a partition A is associated a fc-core A(fc) and a /c-quotient A*^'^^ Jl^. The fc-core is 
the unique partition obtained by successively removing /c-ribbons (or skew hooks) 
from A. The different possible ways of doing so can be distinguished from one another 
by labelling 1 the last ribbon removed, 2 the penultimate, and so on. Thus Figure |l| 
shows two different ways of reaching the 3-core A(3) = (2, 1^) of A = (8, 7^, 4, 1^). 
These pictures represent two 3-ribbon tableaux Ti, T2 of shape A/A(3) and weight 
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Figure 1: 



To define fc-ribbon tableaux of general weight and shape, we need some termi- 
nology. The initial cell of a /c-ribbon R is its rightmost and bottommost cell. Let 
6* = be a skew shape, and set a+ = V a, so that a+/a is the horizontal 
strip made of the bottom cells of the columns of 9. We say that 6* is a horizontal 
k-ribbon strip of weight m, if it can be tiled by m fc-ribbons the initial cells of which 
lie in a+Za. (One can check that if such a tiling exists, it is unique). 

Now, a k-ribbon tableau T of shape A/z/ and weight /i = (/^i, . . . , fir) is defined 
as a chain of partitions 

u = a° C C ■ ■ ■ C a'' = X 
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such that la^~^ is a horizontal /c-ribbon strip of weight /Xj. Graphically, T may be 
described by numbering each /c-ribbon of ja^~^ with the number i. We denote by 
Tab fc(A/z/, [i) the set of /c-ribbon tableaux of shape A/i/ and weight /i, and we set 

<l,^ = |Tab,(A/z/, . 

Finally we recall the definition of the fc-sign th[\jv). Define the sign of a ribbon R 
as (—1)'^"^, where h is the height of R. The A;-sign ekiXjv) is the product of the 
signs of all the ribbons of a /c-ribbon tableau of shape Xjv (this does not depend on 
the particular tableau chosen, but only on the shape). 

The origin of these combinatorial definitions is best understood by analyzing 
carefully the operation of multiplying a Schur function Sy by a plethysm of the form 
i^^ih/i) = Pk° hfj,. Equivalently, thanks to the involution uj, one may rather consider 
a product of the type [pk o e^]. To this end, since 

Pfc o = (e^,! opk) ■■ ■ (e^„ o p^) = rrikn ■ ■ ■ m^Mn 

one needs only to apply repeatedly the following multiplication rule due to Muir 
H (see also H): 

Si, nia = ^ Su-^-j3 , 

sum over all distinct permutations /? of (cti, 02, • • • , ctn, 0, . . . ). Here the Schur 
functions s^+js are not necessarily indexed by partitions and have therefore to be put 
in standard form, this reduction yielding only a finite number of nonzero summands. 
For example, 

■531 ^3 = -561 + S313 + S31003 = -561 ~ -5322 + ■5314 • 

Other terms such as S34 or S3103 reduce to 0. It is easy to deduce from this rule that 
the multiplicity 

{si, ruki^i , sx) 

is nonzero iff X'/jJ,' is a horizontal /c-ribbon strip of weight /ij, in which case it is 
equal to ekiX/u). Hence, applying u we arrive at the expansion 

s.[Pkoh,]=J2ekiX/iJ.)K[)l^s, (12) 



from which we deduce by p.2| that 

Ki'l = {-lY'-'^\'\ek{X)K,^.{0 

and more generally, defining as in |2T| the skew Kostka-Foulkes polynomial Kx/u,a{(l) 
by 

Kx/uM = (sx/u, QM) 

(or as the generating functions of the charge statistic on skew tableaux of shape X/fi 
and weight a), we can write 

^vl,. = (-i)^'''^'"'^^(V^)^A/.,,^(C). 



9 



It turns out that enumerating fc-ribbon tableaux is equivalent to enumerating k- 
uples of ordinary Young tableaux, as shown by the correspondence to be described 



now. This bijection was first introduced by Stanton and White ||6] in the case of 
ribbon tableaux of right shape A (without fc-core) and standard weight fi = (l") 
(see also 0). We need some additional definitions. 

Let -R be a /c-ribbon of a fc-ribbon tableau. R contains a unique cell with co- 
ordinates {x, y) such that y — x = { mod k). We decide to write in this cell the 
number attached to R, and we define the type i G {0, 1, . . . , — 1} of as the 
distance between this cell and the initial cell of R. For example, the 3-ribbons of Ti 
are divided up into three classes (see Fig. |l|): 

• 4, 6, 8, of type 0; 

. 1, 2, 7, 9, of type 1; 

• 3, 5, of type 2. 

Define the diagonals of a fc-ribbon tableau as the sequences of integers read along 
the straight lines Di : y — x = ki. Thus Ti has the sequence of diagonals 

((8), (4), (2, 3, 6), (1, 5, 9), (7)) . 

This definition applies in particular to 1-ribbon tableaux, i.e. ordinary Young 
tableaux. It is obvious that a Young tableau is uniquely determined by its se- 
quence of diagonals. Hence, we can associate to a given fc-ribbon tableau T of shape 
X/u a. fc-uple (to, ^i, • • • , tfe-i) of Young tableaux defined as follows; the diagonals 
of ti are obtained by erasing in the diagonals of T the labels of all the ribbons of 
type 7^ i. For instance, if T = Ti the first ribbon tableau of Figure |I|, the sequence 
of diagonals of ti is ((2), (1, 9), (7)), and 
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The complete triple (to, ti, ^2) of Young tableaux associated to Ti is 
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7 



3 5 



whereas that corresponding to T2 is 
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2 7 



One can show that iiu = A(fc), the fc-core of A, the /c-uple of shapes (A°, A\ . . . , A^~^) 
of (to, ti, . . . , tfc_i) depends only on the shape A of T, and is equal to the fc-quotient 
A'^'^^ of A. Moreover the correspondence T — > (to, ti, . . . , tk-i) establishes a bijec- 
tion between the set of /c-ribbon tableaux of shape A/A(fc) and weight /x, and the set of 
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fc-uples of Young tableaux of shapes (A° 



A ) and weights (/i 



/i 



with 



f^i = J2j f^i- (See or for a proof in the case when A(a;) = (0) and /x = (1"")). 
For example, keeping A = (8, 7^, 4, 1^), the triple 



2 3 



with weights ((0, 0, 2, 1), (1, 1, 1, 1), (0, 1, 1, 0)) corresponds to the 3-ribbon tableau 



T 



1 



of weight /i = (1, 2, 4, 2). 

As before, the significance of this combinatorial construction becomes clearer 
once interpreted in terms of symmetric functions. Recall the definition of 0^, the 
adjoint of the linear operator ip'^ : F \^ o F acting on the space of symmetric 
functions. In other words, 0^ is characterized by 

, G) = (F , o G) , F, G G Sym . 

Littlewood has shown that if A is a partition whose fc-core A(fc) is null, then 

(pk^sx) = efe(A) Sao Sai • ■ ■ Sa^-i (13) 

where A'-^^ = (A°, . . . , A'^"^) is the fc-quotient. Therefore, 



K 



(k) 

A fi 



efc(A) {pk o hf, , sx) = efe(A) (^^(sa) , h^) = {sxo Sx^ ■■■ Sx^-i , h^) 



is the multiplicity of the weight fi in the product of Schur functions Sxo ■ ■ ■ Sa^-i, 
that is, is equal to the number of fc-uples of Young tableaux of shapes (A", . . . , A'^"^) 
and weights (/i°, . . . , /i'^"^) with /ij = J2j f^i- Thus, the bijection described above 
gives a combinatorial proof of (0). 

More generally, if A is replaced by a skew partition A/z/, (p!3D becomes |17| 



(pkisx/iy) = efc(A/z/) sao/,,0 sai/i/1 ■ ■ ■ Sxk-i/i,k-i 

if A(fc) = z/(fc), and otherwise. This can also be deduced from the previous combi- 
natorial correspondence, but we shall not go into further details. 

Returning to Kostka polynomials, we may summarize this discussion by stating 



Theorems 3.1 and 3.2 in the following way 
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Theorem 4.1 Let A and v he 'partitions and set u = jj^ \/ a with mj(a) < k. 
Denoting by ( a primitive kth root of unity, one has 

KxAO = (-i)^'"'^'"'E^^(V/3)<k.^A"(0 ■ (14) 

Example 4.2 We take A = (4^, 3), z/ = (2^ 1^) and A; = 3 (C = e^''^/^). In this case, 
u = fi^ y a with fi = (1^) and a = (2^, 1). The summands of (|1^) are parametrized 
by the 3-ribbon tableaux of external shape A and weight fi. Here we have three such 
tableaux: 





1 


2 











so that 

i^443, 221111111(C) = 2ir41,22l(C) - ^32, 221(C) = 2(C' + C') " (C + C) = 2C' + 3 . 

When \a\ < \X(k)\, QT^ ) becomes simpler. For if |a| < |A(fc)| then Kx^uiC) = 0, 
and otherwise the sum reduces to one single term 

KUO = (-l)^'"^^'^'e;.(A/A(.))irf4„,ir,,,,«(C) . 

In particular, for u = (1"), one recovers the expression of i^A,(i")(C) given by Morris 
and Sultana |^ . 



Finally, let us observe that the notion of fc-sign of a partition can be lifted to a 
statistic on ribbon tableaux, which for technical reasons that will become transparent 
later, takes values in N + |N, and will be called spin. 

Let i? be a /c-ribbon, h{R) its heigth and w{R) its width. 



h(R) 



w(R) 



The spin of R, denoted by s{R), is defined as 



(15) 



and the spin of a ribbon tableau T is by definition the sum of the spins of its ribbons. 
For example, the ribbon tableau 



12 



6 



has a spin equal to 6. 

The fc-sign of a partition A is thus equal to (— 1)^**^-^^ for any ribbon tableau T 
of shape A. For example, we can rewrite the particular case v 
as 



St 



(0) of formula ([ID 
(16) 



E ( 

TGTabfe{-,/i) 

where Tabfc( ■ is the set of /c-ribbon tableaux of weight /i, and st = sa if A is 
the shape of T. We shall see in the next section that this formula leads to a simple 
construction of a basis of highest weight vectors in the Fock space representation of 
the quantum affine algebra f/g(5[„). 



5 The Fock representation of Uq{sin 



The affine Lie algebra s[„ = A^^li has a natural action on the space Syin of sym- 
metric functions, called the bosonic Fock space representation. This representation 
is equivalent to the infinite wedge, or fermionic Fock space representation, and the 
isomorphism can be realized by means of vertex operators (see e.g. |T5| ). 

Let us recall briefiy the fermionic version. Let V be the vector space C'-^-' and 
('Wi)jeZ be its canonical basis. The fermionic Fock space A°° V is defined as the 
vector space spanned by the infinite exterior products A A ■ ■ ■ A Mi„ A ■ ■ ■ 
satisfying zi > ^2 > ^3 > • • • > "^n > • • • and ik — ik+i = 1 for A; >> 0. The wedge 
product is as usual alternating, and linear in each of its factors. We denote by JF 
the subspace of A°° V spanned by the elements such that = —k + 1 ioi k » Q 
(usually this subspace is denoted by JF(°) , but as we shall not need the other sectors 
we drop the superscript). 



The Lie algebra glg^^ of Z x Z complex matrices A 
nonzero entries acts on f\°° V by 



j) with finitely many 



A - /\ Ui^ A 



A A 



+ Mil (Aui^) A h 



the sum having only a finite number of nonzero terms. 



Let Eij be the infinite matrix {Eij)r 



The subalgebra sloo of gl^ con- 



stituted by the matrices with zero trace has for Chevalley generators e°° = 



Ei^i^i and hi 



Ei^i — -Ej+i^j+i, z G Z. 



The infinite sums 



j=i mod n 



E /r 

j=i mod n 



hi 



E hf 

=i mod n 
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do not belong to gi^, but they have a well-defined action on A°° and it can be 
checked that they generate a representation of s[„ with central charge c = 1. The 
remaining generator D of s[„ = st^ © CD can be implemented by 



{Eu - e{-i - 1)) 



where ^(a;) = 1 for x > and 9{x) = otherwise (c/. 

The basis vectors of can be labelled by partitions, by setting 

|A) = a MA2-1 A MA3-2 A ■ • • . 

With this indexation, the action of the Chevalley generators of sin can be described 
as follows 

To each node (i, j) of a Young diagram, one can associate its residue pij = 
j — i mod n G {0, . . . , n — 1}. Then, 

e.|A) = El/^)' MA) = EI^) (17) 

where fi {resp. v) runs over all diagrams obtained from A by removing {resp. 
adding) a node of residue r. 

In this picture, one can observe that and fr are exactly the r-restricting and 
r-inducing operators introduced by G. de B. Robinson in the context of the modular 
representation theory of the symmetric group |H3 . 



The natural way of interpreting the basis vectors |A) as symmetric functions is 
to put I A) = sx. This is imposed by the boson- fermion correspondence, and it is 
also compatible with the modular representation interpretation. 

In this realization, it can be shown that the image ?7(s[„)|0) of the constant 
|0) = So = 1, which is the basic representation M(Ao), is equal to the subalgebra 

r(") = C[pi\i^O mod n] 

generated by the power-sums Pi such that n J(i. 
The bosonic operators 



d_ 

dpkn 



hk : /i — > Dp^^f = kn^^f and b^k ■ /i — ' Pknf {k > 1] 



commute with the action of s[„. They generate a Heisenberg algebra Ti, and the 
irreducible ?i-module U{'H)\0) is exactly the space S^""^ of highest weight vectors 
of the Fock space, viewed as an s[„-module. Thus, these highest weight vectors 
are exactly the plethysms '?/'"(/),/ G Sym. Natural bases of iS*^"-* are therefore 
V'"(P/i) = Prifj., ^'"(■5^) or ip'^{h^). We know from Section § that this last one admits 
a simple combinatorial description in terms of ribbon tableaux: 

r{h,) = E en{X/^^)K^^Js, = E (-I)'^^^^^t ■ (18) 

A TGTab„(-,/i) 
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This formula is especially meaningful in the quantized version, that we shall now 
describe. 

We first recall the definition of Ug{sln) {cf. and references therein). Let () 
be a (n + l)-dimensional vector space over Q with basis {Hq, hi, ... , hn-i, D}. We 
denote by {Aq, Ai, . . . , A„_i, 6} the dual basis of t)*, that is, 

(A„ h,) = 6,j, (A„ D) = 0, (5, h,) = 0, {5, D) = 1, 

and we set = 2Aj — Aj_i — A^+i + 6io 6 for i = 0,1, ... ,n — l. In these formulas it is 
understood that A„ = Aq and A_i = A„_i. The n x n matrix [(ctj, hj)] is the gener- 
alized Cartan matrix associated to The weight lattice is P = (0"=o^ ZAj) Z6, 
its dual is = (©"Jq^ Z /i^) Z P>, and the root lattice is Q = ©"Jo^Zai. One 
defines Uq{sln) as the associative algebra with 1 over Q(g) generated by the symbols 
Cj, fi, < i < n — 1, and q'^, h G P^, subject to the relations 



l-{ai,hj) 

E 

A:=0 

l-{ai,hj) 



-11 



q' q'' = q^' 


g° = i, 


q'e.q-' - 


- q Cj, 






/j] ^ii 1 ! 

g — q-^ 


1 - (oj, hj) 


l-{ai,hj)-k 


k 





k 



{^^J] 



E 

k=0 



:-ii 



{ai, hj) 
k 



j.l-(ai,hj)-k f 



Here the g-integers, g-factorials and g-binomial coefficients are the symmetric ones: 



[k] 



q-q- 



[k]\ = [k] [A:-l]---[l], 



m 
k 



\m\\ 



[m-A;]![A;]! 



We now recall some definitions relative to [/g(s[„) -modules. Let M be a Uq{sln)- 
module and A G P a weight. The subspace 

Ma = {f G M I g% = g^^''^^ v, h e P""} 

is called the weight space of weight A of M and its elements are called the weight 
vectors of weight A. The module M is said to be integrable if 

(i) M = ®^^pMa, 

(ii) dim Ma < oo for A G P, 

(iii) for i = 0,1, . . . ,n — 1, M decomposes into a direct sum of finite 
dimensional t/j-modules, where Ui denotes the subalgebra of Uq{sln) gen- 
erated by Ci, fi, q'^\ q-^\ 
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A highest weight vector f G M is a vector annihilated by all raising operators Cj. 
The module M is said to be a highest weight module if there exists a highest weight 
vector V such that M = Uq{sln)v. The weight of v is called the highest weight of 
M. 

By the representation theory of t/g(s[„), there exists for each dominant integral 
weight A {i.e. (A, hi) G Z+ for i = 0, 1, . . . , n — 1) a unique integrable highest weight 
module M(A) with highest weight A. 

A g- analog of the Fock representation of s[„ can be realized in the Q(g)-vector 
space JF spanned by all partitions: 

•^=eQ('?)iA) 

Xev 

the action being defined in combinatorial terms. 

Let us say that a point (a, b) of Z_|_ x Z_|_ is an indent z-node of a Young diagram 
A if a box of residue i = a — b mod n can be added to A at position (a, b), in such a 
way that the new diagram still corresponds to a partition. Similarly, a node of A of 
residue i which can be removed will be called a removable i-node. 

Let iG{0,l,...,n — 1} and let A, z/ be two partitions such that u is obtained 
from A by filling an indent i-node 7 We set: 

Aj(A) = jj{ indent i-nodes of A } — }]{ removable i-nodes of A }, 

^^^(A, z/) = tl{ indent i-nodes of A situated to the left of 7 (not counting 
7) } — jj{ removable z-nodes of A situated to the left of 7 }, 

Nl{X, z/) = tl{ indent i-nodes of A situated to the right of 7 (not counting 
7) } — tl{ removable z-nodes of A situated to the right of 7 }, 

iVO(A) = tl{ 0-nodes of A }. 



nodes to the left of 7 



nodes to the right of 7 



The following result is due to Hayashi |TT|, and the formulation that we use has 
been given by Misra and Miwa |Q (with a slight change in the conventions, that is 
conjugation of partitions and q ^ 1/q). 

Theorem 5.1 The algebra Uq{sln) acts on JF by 
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\X) = I A) , 

qD\X)=q-^"W\X), 

fi\^) = Y,u Q^'" ^'^''^'^ W) 7 sum over all partitions v such that vjX is a i- 
node, 

^iW) = J^xQ^^^^''^'"^ \^) , sum over all partitions X such that vjX is a 
i-node. 

It is easy to see that JF is an integrable f/q(s[„)-module. It is not irreducible. Actually 
it decomposes as 

= M(Ao - kSfP^^^ . 

k>0 

Obviously, the empty partition |0) is a highest weight vector of weight Aq. The 
submodule f/g(s[„) |0) is isomorphic to M(Ao), also called the basic representation 
of Uq{sln)- Again, one can identify with Sym (with coefficients in Q(g) and 
interpret |A) as sx. Then, a natural g-analog of (|r^) gives a basis of highest weight 
vectors for Ug{sln) in JF: 

Proposition 5.2 Define a linear operator ip": on Sym by 



E 



-9) 



-2s{T) 



St . 



TeTab„(-,At) 



Then, its image ijj^{Syni) is the space Sj^^ of highest weight vectors of Ug{sln) in 
Sym. 

Example 5.3 The plethysm ^^^(^21) is given by the following domino tableaux 



1 1 2 







1 


1 


2 





1 




1 




to 



2 




1 


1 


2 




1 


1 





2 


1 


1 


2 




1 


1 





1 




1 




to 



2 


1 


1 



ts3 




1 


1 



and the corresponding highest weight vector of Uq{si2) is 

i^qihl) = S6 - q~^S5i + (1 + g~^)s42 - ^"^5411 
-{q^-^ + g"^)s33 + q^^S-sui + g"^S222 - g"^S2211 

The proposition is a consequence of the following more precise statement. 
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Theorem 5.4 Let Uk, Vk (k>l) be the linear operators defined by 



A* VrGTab„(At/A,{fc)) 



I' \reTab„(A/i/,(fc)) 

so that Vk is a q-analog of f ^ '^"'{hk)f, o-nd Uk is its adjoint. Then, Uk and Vk 

commute with the action of Ug{5ln)- In particular, each ipg{h^) = V^^ ■ ■ ■ V^JO) is a 
highest weight vector. 

This result can be obtained by a direct verification, using formula (|I2|). However, 
a more illuminating approach comes from comparison with a recent construction 
of Stern and Kashiwara, Miwa and Stern |TB[. These authors construct the q- 



analog of the Fock representation by means of a g-deformation of the wedge product, 
defined in terms of an action of the affine Hecke algebra Hjsi{q~'^) on a tensor product 
l^(z)®"' of evaluation modules. 
Here, V{z) is C'''^^ realized as 

where z'^Vj is identified with Uj-ni, endowed with an appropriate g-analog of the 
action of s[„ on V. 

Writing z^'^Vm-^ ® ■ ■ ■ z'^^v^m as VmZ^ = Vm^ ® ■ ■ ■ Vm^ ■ -^1^ ■ ■ ■ ^iv" 5 "the right 
action of Hjq^q^"^) on V{z)®^ is described by the following formulas [H, |T^: 



Hi acts as z^ ^ and 

f -q'^v^a, ■ c^iiz"") + (g"^ - l)v^ ■ diiziz"") if rui < rui+i 

{Vm-Z^)Ti=l -Vm. ■ Cri{z'') + {q-"^ - l)v-cn ■ Zidi{z'') mi = TTLi+i (19) 

[ -q'^Vma, ■ cri{z'') + (g^^ - l)vm ■ Zidi{z'') if > m^+i 

where mcTj = (mo-(i), . . . ,'ma.(Ar)) and di is the divided difference operator f{z) ^ 
(/ — <^i{f))/{zi — Zi^i). This action can be regarded as a generalization of the one 
given in [^, which would correspond to the degenerate case n = 1. 

The important point is that this action commutes with f/g(s[„). Let A^^'> = 
J2a(^SN -^<^- "^^^^ is a g-analog of the total antisymmetrizer of S^, since signs have 
been incorporated in formulas (|T^ in such a way that Tj acts as a g-analog of 
— (Tj. Kashiwara, Miwa and Stern define then the g-exterior powers by ^(-2) = 
V (z) / ker A^'^\ and denote by Ag ■ ■ ■ Ag Ui^ the image of (8> ■ ■ ■ ® in the 
A Kocic A ^ V (z) IS formcd by the normally ordered products Ui-^ Ag 



■ ■ ■ Ag Uij^, where ii > 12 > ■ ■ ■ > in, and any g-wedge product can be expressed 
on this basis, by means of the following relations iteratively applied to consecutive 
factors. Suppose that i < m and that i — m mod n = i. Set t = q~^. Then, 
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— if 2 = then ut, Aq Um = —Um Ag Ue 

— otherwise, Ui Ag Um = -tUm Ag Ui + {t^ - l){Um-i Aq Ui+i - tUm-n Ag 
^m+n ~l~ t U^—n—i Ag Ui^n+i ~l~ ' ' ') 

where the only terms to be taken into account in this last expression are the normally 
ordered ones. 

There is then a well-defined action of Uq{sln) on the "thermodynamic limit" 
= ^(-2^) = hm7v->oo ^(2^)) which provides another realization of the g-Fock 
representation. 

The affine Hecke algebra does not act anymore on but its center does. 

This center is generated by the power sums 

p,{Y) = J2yf k = ±i,±2,... 

i=l 

and at the thermodynamic limit, the operators 

00 



k 

Ui 
1=1 



are shown in [|16| to generate an action of a Heisenberg algebra on jFg, with 



q2nk 



[Bk,Be\=k ^ \^ -S.^.e. (20) 



If one interprets the infinite g-wedges as Schur functions, by the same rule as in 
the classical case, one sees that B^k {k > 1) is a g-analogue of the multiplication 
operator / 1— pnkf, and that B^ corresponds to its ajoint Dp^^. 

To connect this construction with the preceding one, take for generators of the 
center of the affine Hecke algebra the elementary symmetric functions in the t/i and 
instead of the power sums, and define operators on JF^ by 

Uk = Ckivi, 1/2, ■■■), Vk = Ckivi^, y2^, ■■■) ■ 

These operators commute with Uq{sin), and their action can be described in terms 
of ribbon tableaux: 



Lemma 5.5 



^^.|A) = E E (21) 

1^ \T€Ta.h n{X' /v' ,{k)) 

m=j:i E (-^r^^^M 1/^) • (22) 



Proof — It is sufficient to work with Aq ^(-2) for sufficiently large. Then, 

VkUi-^ Aq ■ ■ ■ Aq Uij^ = ^ Uij^+ji Aq ■ ■ ■ Aq Uij^+jj^ 

J 
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where J runs through the distinct permutations of the integer vector {^^~^n^). The 
only reorderings needed to express a term of this sum in standard form are due to 
the appearance of factors of the form Ui Ag Uj+n with j + n > i > j . In this case, 
UiAgUj+n = —tUj+n/\qUi siuce the other terms (t^ — l)('Uj+„__aAgMj+a— t-Uj Ag'Uj+„+- ■ ■) 
vanish, the residue a = j + n — i mod n being actually equal to j + n — i. The first 
case of the straightening rule is never encountered because j + n — i = mod n 
would imply i — j = bn with & > 0, so that j + n ^ i. 
Thus, 

where a is the shortest permutation such that the result is normally ordered. In 
view of the remarks in Section ^, this gives the result for Vk- The argument for Uk 
is similar. 

Corollary 5.6 The operators Uk, Vk of Theorem \5.4 act on Tq as hk{yi, y2, ■ ■ •) and 
hkiVi^ ,y2^ J ■ ■ •) respectively. In particular, [Ui, Uj] = [Vi, Vj] = 0. 

6 i/-functions 

Let A be a partition without fc-core, and with A;-quotient (A°, . . . , A'^"^). For a ribbon 
tableau T of weight /x, let Then, the correspondence between k- 

ribbon tableaux and /c-tuples of ordinary tableaux shows that the generating function 

E ^^=n E ^*' = n^v (23) 

is a product of Schur functions. Introducing in this equation an appropriate statis- 
tic on ribbon tableaux, one can therefore obtain g-analogues of products of Schur 
functions. The statistic called cospin, described below, leads to g-analogues with 
interesting properties. 

For a partition A without A;-core, let 

4(A) =max{s(T) |Te Tabfe(A, ■■•)}• (24) 

The cospin s(T) of a /c-ribbon tableau T of shape A is then 

S{T) = sliX) - s{T) . (25) 

Although s(T) can be a half- integer, it is easily seen that s{T) is always an integer. 
Also, there is one important case where s{T) is an integer. This is when the shape A 
of T is of the form kfi = (fc/ii, kfi2, ■ ■ ■ , kfir)- In this case, the partitions constituting 
the fc-quotient of A are formed by parts of /i, grouped according to the class modulo 
k of their indices. More precisely. A* = {fir \ r = —i mod k} 
We can now define three families of polynomials 
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G^'\X:q)= E <l'^^^^^ (26) 

TgTab fe(A, ■ ) 

Hf\X-q)= E q'^^^x^ = Gtl{X-q) (27) 

TeTabfc(fc/i,-) 

Hf\X- q)= E = g^^^'^^^^f (^; l/g) • (28) 

The parameter A; will be called the level oi the corresponding symmetric functions. 

Theorem 6.1 (symmetry) The polynomials G^^\ and Hj^^ are symmetric. 

This property follows from Corollary ^.6| . Indeed, the commutation relation 
[Vi, Vj] = proves that if a is a rearrangement of a partition /i, 

which shows that for any partition A, the sets Tabfc(A,/i) and Tabfc(A,Q;) have the 
same spin polynomials. 

Remark 6.2 If one defines the linear operator ip'^ as the adjoint of ip^ for the 
standard scalar product, the if-functions can also be defined by the equation 

Hi'\X;q-')=^';{s,,) . (29) 

There is strong experimental evidence for the following conjectures. 

Conjecture 6.3 (positivity) Their coefficients on the basis of Schur functions are 
polynomials with nonnegative integer coefficients. 

Conjecture 6.4 (monotonicity) H^^^^^ — H^^^ is positive on the Schur basis. 
Conjecture 6.5 (plethysm) When ji = , for ( a primitive k-th root of unity, 

and more generally, when d\k and ( is a primitive d-th root of unity, 

Equivalently , 

1=0 

The following statements will be proved in the forthcoming sections. 
Theorem 6.6 For k > i^J,), H^"* is equal to the Hall-Littlewood function Q'^. 
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Theorem 6.7 The difference Q'^ — Hj^^ is nonnegative on the Schur basis. 



Taking into account the results of ^ and [@], this is sufficient to estabhsh 
the conjectures for k = 2 and k > i{fi). 

Example 6.8 (i) The 3-quotient of A = (3, 3, 3, 2, 1) is ((1), (1, 1), (1)) and 



G3332i{q) = m3i + (l + g)m22 + (2 + 2g + g^)m2ii 
+ (3 + 5g + 3g2 + g^)miiii 
= S31 + qs22 + iq + q'^)s2u + q^Suu 



is a g-analogue of the product 

SlSiiSi = S31 + S22 + 2S2ll + Siiii . 

(ii) The i7-functions associated to the partition A = (3, 2, 1, 1) are 

(2) 

-^3211 = -53211 + q S322 + q S331 + q -54111 

+ (g + g^) S421 + q^ S43 + q^ S511 + S52 

-f^32ii = 53211 + q S322 + {q + q^) S331 + q S4111 

+ (g + 2g2) S421 + (g2 + q^) + (g^ + ^^^^ 

+2g^ S52 + S61 

^3211 = -53211 + q S322 + (g + g^) -S331 + q -54111 

+(g + 2g2 + g3) S421 + (g^ + g^ + g^) S43 + (g^ + g^ + g^) sgn 
+ (2g3 + g4 + g5) + (g^ + g^ + g^) Sgi + g^ s-j 

— Q3211 



and we see that S3211 < -^3211 < ^^3211 < -^^3211 = Q3211 • 

(iii) The plethysms of S21 with the cyclic characters £3 ■* are given by the reduction 
modulo 1 — g^ of 

^222111 = g^S63 + (g + l)g^S62i + g^seiii + (g + l)g^S54 + (g^ + 2g^ + 2g + l)g^S53i 
+(g' + 2g + l)g^S522 + (g^ + 2g2 + 2g + l)gS52ii + (g + l)gS5iiii 
+(g2 + 2g + l)g^S44i + (g^ + 2g2 + 3g + 2)g^S432 + (2g^ + 3g2 + 3g + l)g=^S43ii 
+ (g3 + 3g2 + 3g + 2)g3s422i + (g^ + 2g2 + 2g + l)g's42iii + g^S4iiiii + (g^ + l)g^S333 
+ (2g3 + 3g2 + 2g + I)g2s332i + (g' + 2g + l)g's33iii + (g' + 2g + I)g2s3222 

+ (g^ + 2g^ + 2g + l)gS32211 + (g + l)g-5321111 + (g + l)g-522221 + -5222111 
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Indeed, 



-f^222iii mod I- 



(2S52ii + S2222I + ■S321111 + 3S43ii 

+2S322II + 5522 + 3S432 + 3S332l + S33111 + S3222 + ■S51111 
+3^4221 + 2S531 + 2S42111 + S54 + ^621 + 5441)^^ 
+ (2S52ii + S2222I + ■5321111 + 3S43ii + 2^32211 + S522 
+3S432 + 3S332i + S33111 + S3222 + ■§51111 
+3S4221 + 2S53i + 2S42111 + ■S54 + ■§621 + ■S441)'? 
+2^33111 + S63 + ■§6111 + 2^531 + 2^522 + 2^5211 + 2^441 
+2S432 + 3S43ii + 3S4221 + 2S42lll + ■S411111 + 2^333 
+2S3321 + 2^3222 + ■5222111 + 2^32211 



O S21 + 4 ° ^521 



7 The case of dominoes 



For k = 2, the conjectures can be established by means of the combinatorial con 
struct ions of 



^ and 
from the results of 
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In this case, conjectures |6Tl| , |673| and ^3] follow directly 
and the only point remaining to be proved is Theorem |6.7| . 
The important special feature of domino tableaux is that there exits a natural 
notion of Yamanouchi domino tableau. These tableaux correspond to highest weight 
vectors in tensor products of two irreducible GL„-modules, in the same way as 
ordinary Yamanouchi tableaux are the natural labels for highest weight vectors of 
irreducible representations. 

The column reading of a domino tableau T is the word obtained by reading the 
successive columns of T from top to bottom and left to right. Horizontal dominoes, 
which belong to two succesive columns i and i + 1 are read only once, when reading 
column i. For example, the column reading of the domino tableau 



4 








3 








2 


2 


1 


1 





is col (T) = 431212. 

A Yamanouchi word is a word w = xiX2 ■ ■ ■ x„ such that each right factor v = 
Xi---Xn of w satisfies \v\j > |f|j+i for each j, where \v\j denotes the number of 
occurences of the letter j m. v. 

A Yamanouchi domino tableau is a domino tableau whose column reading is a 
Yamanouchi word. We denote by Yam2(A, /x) the set of Yamanouchi domino tableaux 
of shape A and weight /i. 
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It follows from the results of 0, Section 7, that the Schur expansions of the 
if-functions of level 2 are given by 



H 



(2) 



TeYam2(2A,^t) 



On the other hand, 



Qa = E e ^ 



c{t), 



(30) 



(31) 



M teTab(^t,A) 

To prove Theorem |6.7|, it is thus sufficient to exhibit an injection 



satisfying 



Tj : Yam2(2A, yu) — > Tab (yU, A) 



c(ry(r)) = s(T) . 



To achieve this, we shall make use of a bijection described in [0, and extended in |T9| , 
which sends a domino tableau T G Tab 2{.0i, n) over the alphabet X = {1, . . . , n}, to 
an ordinary tableau t = 0(T) G Tab (a, /i/i) over the alphabet XU X = {n < . . . < 
1 < 1 < . . . < n}. The weight /i/i means that t contains /Xj occurences of i and of i. 
The tableau 0(T) is invariant under Schiitzenberger's involution f2, and the spin of 
T can be recovered from t by the following procedure . 

Let a = 2A, /5 = a', /5odd = (/5i,/33, • • • ) and /3even = {132,^4, ■)■ Then, there 
exists a unique factorisation t = T1T2 in the plactic monoid PI {XUX), such that ri is 
a contretableau of shape = (Peven)' and r2 is a tableau of shape = (/3odd)'- The 
spin of T = 0~^(t) is then equal to the number |ti|+ of positive letters in ri, which 
is also equal to the number \T2\- of negative letters in T2. Moreover, T2 = fi(ri). 

Example 7.1 With the following tableau T of shape (4, 4, 2, 2), one finds 



T 



3 




2 


1 


1 


2 


1 



1 


3 






1 


2 






2 


1 


1 


2 


3 


2 


1 


1 



By jeu de taquin, we find that in the plactic monoid 



1 


1 


3 




2 


1 


2 






2 


1 


2 




3 


I 


1 



The number of positive letters of ti and the number of negative letters of T2 are 
both equal to 1, which is the spin of T. 



24 



This correspondence still works in the general case {a need not be of the form 
2A) and the invariant tableau associated to a domino tableau T admits a similar 
factorisation t = T1T2, but in general T2 7^ S^(ti) and the formula for the spin is 
s(T) = i(|ri|+ + |r2|_). 

The map 1] : Yam2(2A, — > Tab (/x, A) is given by the following algorithm: to 
compute r]{T), 

1. construct the invariant tableau t = (piT) 

2. apply the jeu de taquin algorithm to t to obtain the plactic factorization t = 
T1T2, and keep only T2. 

3. Apply the evacuation algorithm to the negative letters of T2, keeping track of 
the successive stages. After all the negative letters have been evacuated, one 
is left with a Yamanouchi tableau r in positive letters. 

4. Complete the tableau r to obtain the tableau t' = r/(T) using the following 
rule: suppose that at some stage of the evacuation, the box of T2 which disap- 
peared after the elimination of i was in row j of T2. Then add a box numbered 
j to row i of T. 



Theorem 7.2 The above algorithm defines an injection 

ri : Yam2(2A, ji) — ^ Tab (/x. A) 

satifying cor] — s. 



Corollary 7.3 H)^' < Q'^ 



Example 7.4 Let T be the following Yamanouchi domino tableau, which is of shape 
2A = (6, 4, 4, 2, 2), of weight n = (4, 3, 2) and has spin s{T) = 3 



T = 



3 


3 








2 


2 








1 




2 




1 




1 


1 



Then, 



3 


3 








1 


1 


3 


3 




1 


2 








I 


2 


2 




1 


1 


2 


2 




2 


1 


1 


2 




2 


2 


1 


1 






2 


2 


1 




3 


3 


2 


i 


1 


1 






3 


3 


i 


1 
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and the succesive stages of the evacuation process are 



3 
2 






X 

3 






3 






X 






1 


2 




2 


2 




2 


X 




3 






2 


1 




1 


1 




1 


2 




2 


2 




3 


1 


1 




2 


1 


1 




1 


1 


1 




1 


1 


1 



so that we find 



3 
5 



2 
3 



1 

4 



a tableau of shape fi = (4, 3, 2) 



weight A 



3 


5 






2 


2 


3 




1 


1 


1 


4 



(3, 2, 2, 1, 1) and charge c(t') = 3. 



8 The stable case 

As the Q'-functions are known to verify all the conjectured properties of if-functions, 
the stable case of the conjectures will be a consequence of theorem This result 
will be proved by means of Shimomura's cell decompositions of unipotent varieties. 

8.1 Unipotent varieties 

Let u G GL{n, C) be a unipotent element, and let J^"[C] be the variety of z/-fiags of 
C" which are fixed by u. 

It has been shown by N. Shimomura (|^, see also [0) that the variety J^"[C] 
admits a cell decomposition, involving only cells of even real dimensions. More pre- 
cisely, this cell decomposition is a partition in locally closed subvarieties, each being 
algebraically isomorphic to an affine space. Thus, the odd- dimensional homology 
groups are zero, and if 

n.^(t') =E^''dimi/2.(^",Z) 

i 

is the Poincare polynomial of JF"[C], one has |JF"[Fg]| = Iiy^{q). But this is also 
equal to G^^iq), and as this is true for an infinite set of values of q, one has Ilufj.{z) = 
Gufj.{z) as polynomials. That is, the coefficient of on the monomial function rrii, 
is the Poincare polynomial of JF", for a unipotent u of type /i. 
Writing 

0; = E^AM.)^A.m, , (32) 

one sees that 

G.,{q)= E q'^''^- (33) 

(ti,t2)eTab (A,/^)xTab {u,fi) 
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Knuth's extension of the Robinson-Schensted correspondence p2[ is a bijection be- 
tween the set 

Y[Tah{\,fi) X Tab (A, z/) 

A 

of pairs of tableaux with the same shape, and the double coset space S^\Sn/S^ of 
the symmetric group Sn modulo two parabolic subgroups. Double cosets can be 
encoded by two-hne arrays, integer matrices with prescribed row and column sums, 
or by tabloids. 

Let u and /i be arbitrary compositions of the same integer n. A /i-tabloid of 
shape 1/ is a filling of the diagram of boxes with row lengths i/i, 1/2, . . . , z/^, the lowest 
row being numbered 1 (French convention for tableaux), such that the number i 
occurs Hi times, and such that each row is nondecreasing. For example. 



3 




1 


1 


1 


1 


1 


3 


2 


3 





is a (5, 1, 3)-tabloid of shape (2, 3, 3, 1). 

We denote by L(z/, /x) the set of tabloids of shape u and weight /i. A tabloid 
will be identified with the word obtained by reading it from left to right and top to 
bottom. Then, 



TeLiu,fi) 



c{T) 



(34) 



Example 8.1 To compute 6^42,321(^7) one lists the elements of L((4, 2), (3, 2, 1)), 
which are 



2 


3 




1 


1 


1 


2 



2 


2 




1 


1 


1 


3 



1 


3 




1 


1 


2 


2 



1 


2 




1 


1 


2 


3 



1 


1 




1 


2 


2 


3 



Reading them as prescribed, we obtain the words 

231112 221113 131122 121123 



111223 



whose respective charges are 2, 1, 3, 2, 4. The cocharge polynomial is thus (^42,321(9) = 
1 + g + 2g2 + q\ 

In Shimomura's decomposition of the fixed point variety JF^ of a unipotent of 
type z/, the cells are indexed by tabloids of shape u and weight /i. The dimension 
d(T) of the cell ct indexed by T G L(z/, /i) is computed by an algorithm described 
below, and gives another combinatorial interpretation of the polynomial G^^{q), 
exchanging the roles of shape and weight: 



G 



T&L{ii,v) TeL{u,fj.) 



(35) 



The dimensions d{T) are given by the following algorithm. 
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1. If T G L{u, (n)) then d{T) = 0; 

2. li fi = (/^i, /X2) has exactly two parts, and T G fj,), then (i(T) is computed 
as follows. A box a of T is said to be special if it contains the rightmost 1 
of its row. For a box /? of T, put d{P)=0 if /? does not contain a 2, and if 
P contains a 2, set d{(3) equal to the number of nonspecial I's lying in the 
column of (3, plus the number of special I's lying in the same column, but in 
a lower position. Then 

d{T) = J2d{(3) . 

3. Let fi = {fii, . . . , fj,k) and /z* = (/xi, . . . , Hk-ij- For T G L{u, ft), let Ti be the 
tabloid obtained by changing the entries k into 2 and all the other ones into 
1. Let T2 be the tabloid obtained by erasing all the entries k, and rearranging 
the rows in the appropriate order. Then, 

rf(T) = d(Ti) + d{T2) . (36) 



Example 8.2 With T 



1 


4 




1 


2 


3 


1 


1 


2 



G L(332,4211), one has 



1 


2 






1 




1 


1 


h- ' 




1 


2 


3 


1 


1 


h- ' 


T2 = 


1 


1 


2 



21 



1 




1 


1— ' 


2 


1 


1 


1— ' 



22 



1 






1— ' 


2 




1 


I— ' 


2 



where the special entries are printed in boldtype. Thus, d{T) 
2 + d{T2i) + d{T22) = 4. 



t(Ti) +rf(T2) 



We shall need a variant of this construction, in which the shape u is allowed 
to be an arbitrary composition, and where in step 3, the rearranging of the rows 
is supressed. Such a variant has already been used by Terada |^8| in the case of 
complete flags. 

That is, we associate to a tabloid T G L(z/, /x) an integer e(T), defined by 

1. For T G L{u, (n)), e(T) = d{T) = 0; 

2. For T G L{u, {fii,fi2)), e(T) = rf(T); 

3. Otherwise e(T) = e(Ti) + e(T2) where Ti is defined as above, but this time T2 
is obtained from T by erasing the entries k, without reordering. 



Lemma 8.3 Let X = (Ai, . . . , A^) be a partition, and let v = X-a = (Ao-(i), . . . , Xa-(r)), 
a G Sr- Then, the distribution of e on Li^v^ij) is the same as the distribution of d 
on L{X, /i). That is, 

T€LiX,^J.) T€L(u,^J.) 

In particular, Dx^{q) = Exf,{q). 
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Proof — This could be proved by repeating word for word the geometric argument 
of We give here a short combinatorial argument. As the two statistics coincide 



on tabloids whose shape is a partition and whose weight has at most two parts, 
the only thing to prove, thanks to the recurrence formula, is that e has the same 
distribution on L{j3, (/zi, /i2)) as on L{a, (/zi, /i2)) when /? is a permutation of a. The 
symmetric group being generated by the elementary transpositions cij = {i, one 
may assume that /3 = auj. We define the image Tai of a tabloid T G L{a, (/ii,/i2)) 
by distinguishing among the following configurations for rows i and i + 1: 

1. 

xi . . . Xk 2 2"^ CTj xi . . . Xfc 2 2^ 

1 ... 1 12' , 1 ... 1 12'' 

2. 

1 ... 1 1 2^ ai 1 ... 1 1 2" 

Xi ... Xk 2 2'^ > xi ... Xk 2 2^ 

3. In all other cases, the two rows are exchanged: 

Xx ... Xr yi ... Vs 

yi ... ys ^ xi ... Xr 

From this definition, it is clear that e{Tai) = e(T). Moreover, it is not difficult to 
check that this defines an e-preserving action of the symmetric group Sm on the set 
of /i-tabloids with m rows, such that L{a, = L{aa, /i) (the only point needing a 
verification is the braid relation aiai+iai = cri+i(Tj(Ti+i). 

Thus, for a partition A and a two-part weight fi = (/ii,/i2), d and e coincide on 
L(A, /i), and for a G Sm, Exa,^,{q) = Dxfiiq)- Now, by induction, for = (/ii, . . . , /i^), 

TeL{\,^l) 

A=shape (Ti ) A=shape (Ti ) 

□ 



Example 8.4 Take A 
tabloids of shape A are 



(3,2,i; 



(4,2) and u = Xo'icr2 = (3,1,2). The fi- 





2 








1 


2 




T 


1 


1 


1 



d{T) 3 
The t/-tabloids of shape A are 



T 
e(T) 



1 


1 


1 


1 






2 


2 






2 





2 






1 


1 




1 


1 


2 


2 


1 


1 


1 


2 






1 


2 






3 





1 






1 


1 




1 


2 


2 





1 


1 


2 


1 






1 


2 












1 






2 


2 




1 


1 


1 


2 


1 


1 


2 


2 






1 


1 






2 





1 






1 


2 




1 


1 


2 


1 


1 


2 


2 


1 






1 


1 






1 
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Thus, Dxn^q) = E^^^q) = 1 + q + 2q^ + q^ = GjuaI?)- The tabloids contributing a 
term q^ are apparied in the following way: 



2 






1 


1 


2 




1 






1 


1 


1 


1 


1 




2 






2 


2 




1 






1 


1 


2 




1 


1 




1 


1 


1 




2 


2 





Remark 8.5 The only property that we shall need in the sequel is the equality 
D\ij.{q) = Exfj,{q)- However, it is possible to be more explicit by constructing a 
bijection exchanging d and e. The above action of can be extended to tabloids 
with arbitrary weight, still preserving e. Suppose for example that we want to apply 
(7i to a tabloid T whose restriction to rows i, i + 1 is 



1 


1 


2 


3 


7 


7 


9 




1 


1 


1 


2 


6 


6 


6 


8 


8 


9 



One first determines the positions of the greatest entries, which are the 9's, in TcTj. 
Starting with an empty diagram of the permuted shape (10, 7), one constructs Ti as 
above by converting all the entries 9 of T into 2 and the remaining ones into 1. Then 
we apply aj to Ti, and the positions of the 2 in TiCTj give the positions of the 9 in 
TcTj. Then, the entries 9 are removed from T ad the procedure is iterated until one 
reaches a tabloid whose rows i and i + 1 are of equal lenghts. This tabloid is then 
copied (without permutation) in the remaining part of the result. On the example, 
this gives 



1 


1 


1 


1 


1 


1 


2 




1 


1 


1 


1 


1 


1 


1 


1 


1 


2 




















9 


1 


1 


1 


1 


1 


1 


1 


1 


1 


2 




1 


1 


1 


1 


1 


1 


2 
















9 





1 


1 


1 


1 


1 


1 




1 


1 


1 


1 


1 


1 


1 


2 


2 



1 


1 


1 


1 


1 


1 


1|2|2| 


1 


1 


1 


1 


1 


1 



















8|8|9| 














9 



















8 


8 


9 










7 


7 


9 





1 


1 


1 


1 




1 


1 


1 


1 


2 


2 


2 












6 


6 


6 


8 


8 


9 


1 


1 


1 


1 


2 


2 


2 




1 


1 


1 


1 
















7 


7 


9 





1 


1 


1 


2 




1 


1 


1 


2 


1 


1 


1 


1 




1 


1 


1 


1 



1 


1 


2 


3 


6 


6 


6 


8 


8 


9 


1 


1 


1 


2 


7 


7 


9 





30 



8.2 Labelling of cells by ribbon tableaux 



A tabloid t of shape u = (i/i, . . . , i/^) can be identified with a /c-tuple (wi, . . . , Wk) 
of words, Wi being a row tableau of lenght z/,. The Stanton- White correspondence 
ip assciates to such a /c-tuple of tableaux a fc-ribbon tableau T = ip{t). Thus, 
the cells of a unipotent variety JF^ (where u is of type v) are labelled by fc-ribbon 
tableaux of a special kind. The following theorem, which implies the stable case 
of the conjectures, shows that this labelling is natural from a geometrical point of 
view. 

Theorem 8.6 The Stanton-White correspondence ip sends a tabloid t G Liu, fi) 
onto a ribbon tableau T = ip{t) whose cospin is equal to the dimension of the cell ct 
of labelled by t, when one uses the modified indexation for which the dimension 
of Ct is e(t) (see Section^. That is, 

Sim) = e(t) . 

The proof, which is just a direct verification, will not be given here. 

At this point, it is useful to observe, following |Q, that the e-statistic can be 
given a nonrecursive definition, as a kind of inversion number. Let t = [wi, . . . , Wk) 
be a tabloid, identified with a fc-tuple of row tableaux. Let y be the r-th letter of 
Wi and X be the r-th letter of Wj, and suppose that x < y. Then, the pair {y, x) is 
said to be an e-inversion if either 



or 



(a) 2 < J 

(b) i > j and there s on the right of x in Wj a letter u < y 
Then e(t) is equal to the number of inversions in t. 



Example 8.7 Let t G L((2, 3, 2, 1), (2, 3, 1, 1, 1)) be the following tabloid (the num- 
ber under a letter y is the number of e-inversions of the form {y,x)): 



2 3 



1 1 2 



4 5 



V 1 1 3 1 1 / 

so that e(t) = 7. Its image under the SW-correspondence is the 4-ribbon tableau 







4 


5 






2 


2 


3 






1 




1 


2 



whose cospin is equal to 7. 
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8.3 Atoms 



The if-functions indexed by columns can also be completely described in terms of 
Hall-Littlewood functions. 



Proposition 8.8 Letn = sk + r withO <r<k, and set \ = {(s + lY,s'' ''). Then, 

where uj is the involution s\ ^ sy . 

The fc-quotient of (A;") is (I'', . . . , I'', 1"*"^"^, . . . , where the partition (1'^) is 

repeated k — r times. Thus, a fc-ribbon tableau is mapped by the Stanton- White 
correspondence to a fc-tuple of columns, which can be interpreted as a tabloid, and 
the result follows again from Shimomura's decomposition. 

The partitions arising in Proposition ^]8| have the property that, if < denotes 
the natural order on partitions, 

a < A ^ e{a) < . 

There are canonical injections 

Lap '■ Tab ( ■ , «) — > Tab {■ , P) 



when a < (3 {cf. Q). The atom A{jj) is defined as the set of tableaux in 
Tab ( ■ which are not in the image of any La^- Define the symmetric functions 
{cocharge atoms) 



Proposition ^.8| can then be rephrased as 



A \teyt(M)nTab (A,Ai) 



c(t) 



sx{X) 



(37) 



r(fc) 
'(1") 



E 4 • (38) 

V£(M)<fc / 

It seems that the difference beween the stable if-functions and the immediately 
lower level can also be described in terms of atoms. For i{X) = r, set 

D,{q) = H^{^ - Hf^ . 

These functions seem to be sums of cocharge atoms over certain intervals in the 
lattice of partitions. 

Conjecture 8.9 For any partition X, there exists a partition /(A) such that 

^A= E 4- 

M</{A) 

Example 8.10 In weight 6, the partition /(A) is given by the following table: 



A 


(51) 


(42) 


(411) 


(33) 


(321) 


(3111) 


(222) 


(2211) 


(21111) 


(mill) 


/(A) 


(6) 


(51) 


(51) 


(42) 


(42) 


(411) 


(321) 


(321) 


(3111) 


(21111) 
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